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ABSTRACT 

Partial  prior  knowledge  is  quantified  by  a range  R(L,U)  of  e-finite  prior 
measures  Q satisfying  L(A)  ^ Q(A)  j<U(A)  for  all  measurable  sets  A , an»i  is 
interpreted  as  a probability  statonent  in  a betting  framework.  The  concept  of 
conditional  probability  distributions  is  generalized  to  that  of  conditional 
measures,  and  Bayes  theorem  is  extended  to  accommodate  unbounded  priors.  According 
to  Bayes  theorem,  the  range  R(L,U)  of  prior  measures  is  transformed  upon 
observing  X into  a similar  range  R(Lj^,Uj^)  of  posterior  measures.  Upper  and 
lower  expectations  aa\d  variances  induced  by  such  ranges  of  measures  are  obtained. 
Under  weak  regularity  conditions,  these  upper  and  lower  posterior  expectations  are 
strongly  consistent  estimators.  The  range  of  posterior  expectations  of  an  arbi- 
trary function  b on  the  parameter  space  is  asymptotically  b^^  i 
2 

where  b^^  and  are  the  posterior  mean  and  variance  of  b induced  by  the 

upper  prior  measure  U , and  where  a is  a constant  reflecting  the  uncertainty 
about  the  prior  in  terms  of  the  derivative  of  L with  respect  to  U . 
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A typical  example  of  the  type  of  problem  that  can  be  handled  by  the 
methods  discussed  in  this  paper  is  the  estimation  of  the  mean  and  standard 
deviation  of  a normal  distribution.  The  Bayesian  method  proceeds  by  first 
assvuninq  a probability  distribution  for  the  unknown  mean  and  standard  devia- 
tion (the  so-called  prior) . Then  measurements  are  made  in  the  system,  giving 
svunple  information.  Estimates  of  the  un)aiown  mean  and  standard  deviation  are 
made  by  combining  the  assumed  prior  and  the  sample  information,  producing  an 
updated,  or  poster ior , distribution  for  tlie  parameters  to  bo  estimated  (the 
mean  and  standard  deviation  in  this  case) . Typically,  the  posterior  distribu- 
tion responds  to  increasing  empirical  evidence  by  concentrating  about  the  true 
pai.uneter  values. 

In  practice,  it  is  extremely  demanding  to  require  the  experimenter  to 
state  a precise  prior  distribution  for  the  parameters  of  interest;  liowt'ver, 
vague  prior  knowledge  usually  exists.  Furthermore,  Bayesian  inference  is  seme- 
t imos  criticized  by  the  objective  scientific  community  because  of  its  dependence 
on  subjective  prior  information.  Thus,  it  is  important  that  the  sensitivity  of 
t'.iyesian  techniques  to  the  prior  be  assessed,  and  that  inferentially  useful 
mat hemat  ical  structures  for  quantifying  vague  prior  )aiowledge  be  developed. 

Tlte  purpose  of  this  paper  is  to  explore  tlu'  inferential  usefulness  of 

I 

specifying  a range  of  priors.  This  is  done  in  a way  that  is  particularly  easy 
to  specify  in  practice  and  which  leads  to  new  insights  into  tlie  robustness  of 
U.iyesian  technic^es. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lien  with  MRC,  and  not  with  the  authors  of  this  report. 
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1 . Intrcxluction 

The  personalistic  ftiyesian  approach  to  statistical  inference,  as  axiomatired  by 
Ramsey  (1926),  de  Finetti  (1937),  and  Savage  (1954),  demonstrates  tliat  a coherent  system 
of  prior  lieliefs  about  a class  of  propositions  must  be  consistent  with  a unique  proba- 
bility distribution  on  that  class  of  propositions.  Furthermore,  coherent  revision  of 
prior  opinion  given  empirical  evidence  must  conform  to  Bayes  theorem.  In  practice,  prior 
knowledge  is  typically  vague  and  any  elicited  prior  distribution  is  only  an  approximation 
to  the  true  one.  Thus,  less  stringent  modes  of  quantifying  subjective  information  would 
facilitate  the  practicality  of  the  Bayesian  approach  and  would  insure  protection  against 
the  inferential  errors  that  could  result  from  the  discrepancy  between  the  elicited  and 
true  prior. 

Keynes  (1921)  proposed  that  probability  should  be  a partial  ordering  on  f>airs  of 
propositions,  induced  by  statements  of  the  form  "A  given  B is  more  probable  than  C 
given  D."  Koojmian  (1940)  axiomatized  Keynes'  approach.  If  the  observation  space  can 
be  partitioned  into  events  which  are  judged  equally  probable,  Koopman  developed  a teclinique 
for  assigning  upper  and  lower  numerical  values  to  conditional  probabilities.  Good  (1961) 
offered  an  axiom  system  for  such  upper  and  lower  probabilities,  .smith  (1961)  defined 
upper  and  lower  probabilities  to  correspond  to  a range  of  bets  wliich  miglit  be  accepted  for 
or  against  a proposition;  any  probability  between  the  lower  and  upper  proKrliilities  is 
acceptable.  For  a continuous  parameter.  Smith  suggested  accepting  any  of  a convex  family 
of  prior  probability  densities.  Heath  and  Sudderth  (1972)  consider  licts  to  be  random 
v.ir tables  on  seme  sample  space,  and  show  that  if  a convex  set  of  houndi'd  Ix'ts  contains  no 
entirely  negative  bet,  then  there  exists  a finitely  additive  probability  me.rsure  giving 
every  bet  in  the  set  non-negative  expectation;  the  convex  set  of  such  measures  is  tire 
analogue  of  Smith's  range  of  probabilities  for  a single  event.  Heath  and  Sudderth  (197H) 
develop  the  relationship  between  families  of  acceptable  Ix’ts  and  admissible  decisions:  if 
a decision  is  admissible,  it  must  be  worthwhile  betting  on  it  against  other  decisions. 


Sponsored  by  tl;e  United  States  Army  under  Contract  No.  DAAC.29-75-C-0024 . Tliis  material  is 
iMtscHl  U|>on  work  sup|H>rtcd  by  tin-  National  Science  Foindat  ion  under  lUant  Nos.  MCS7H-og''r5 
and  MCS75-08374. 
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T!\tvni<j(u'ut  tht'  tollowinq,  M will  Jftiotc*  flu  Arbitrary  paramotwr  a|>a('e,  amt  0 a 
o-tioUl  of  aubsrts  of  H.  A meflauro  y on  <•'•,6)  is  a non-neqatlve , oountably-adilit ivo 
fum'fion  on  B i v'  •'  t'rotxab)  1 i ty  m«»flauro  if  ^(M)  • 1.  Th«*  analoqup  of  low«»r  and 
uj  jw'i  j'loljflbi  I it  los  fo»  .1  oonvox  sot  c of  probability  mi>nsur»s  is  the  collection  of 
t'Xtjt'iBt’  points  of  the  set)  vimb'r  suitable  conditions,  all  proliability  measures  in  C 
will  1h'  expressible  fls  mixtures  of  extreme  protvability  measures.  Furthermore,  continuous 
Ivne.rr  functiimals  on  C (i.e.  exj'ect  at  ions  of  bounded  mefl.surable  functions  of  0 ) are 
optimised  at  the  extiemi’  points  of  C . We  consider  here  a convex  set  of  measures  (not 
necessarily  proliabilitY  measures)  which  is  esiwcially  simv'le  to  S|iecify  without  reference 
to  extreme  fsiints,  and  on  which  many  functional.s  of  interest  in  statistical  Inference  may 
N'  conveniently  optimized. 

For  a viiven  pair  of  o-finite  measures  1.,  (I  on  (H,B)  satisfying  t.(A)  ^U(A)  for 
all  A > B (denoted  L » (.')  , let  R(l.,lt)  lie  the  convex  set  of  measures  0 satisfying 
1.  V ^ II.  since  w«-  rcpiire  only  that  1,  and  tl  be  o-finlte,  such  useful  prior  measures 
as  I.elw'sgue  measure  may  N'  ai-ciimmodflted.  The  lower  measure  I,  and  the  upj>er  mea.sure  t' 

.are  direct  generalizations  of  the  lower  and  upper  probabilities  of  Kovi|mian  and  .ilmith. 

They  are  not  excessively  burdensome  to  specify,  as  would  be  a completely  gt'neral  convex 
family  of  measures.  B.ayea  tlieorem  "works"  on  the  range  K(I.,U)  in  that  prior  measures  in 
K(L,ll)  map  into  ['osterior  mea.sure,;  ranging  betw*'en  tliose  induced  by  L and  II  . Upiier 
and  lower  {loaterlor  exis'ctatioiia,  quantiles,  and  variances  of  arbitrary  liets  b:f*  » R*  are 
obtained.  And,  finally,  some  attainable  but  not  trivial  asymptotic  results  are  der.ved. 

Under  quite  weak  conditions,  the  upjier  and  lower  jnisteri.ir  expectations  of  b(t»)  are 
strongly  consistent  estimates  of  b(0) i furthermore,  as  the  amount  of  sample  information 
increases,  ttie  r.mqe  of  (xisterior  expectations  of  b((I)  is  approximately  l^  * where 

bj^,  are  the  jiosterior  expectation  and  standard  deviation  of  b{(>)  induced  by  i'  , and 
where  the  multipli-  .i  is  determined  by  the  precision  of  the  prior  range  R<r.,ll>  of 
mi'.asures . 

The  "principle  of  stable  estimation"  I'ut  forward  in  Edwards,  Lindman,  and  Savage  (l^M) 
anil  generalized  by  Dickey  (luTb)  may  U'  expressed  in  terms  of  ranges  of  prior  measures. 
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Kot  .«  I'Aiamotvr  0 , it  is  aaaumpd  that  th«  prior  dansity  p aatlaflea  c < p(0)  > 

(lip)*.  for  0 < P and  p(i')  ^ >c  for  all  . Thla  la  juat  the  range  of  neaaurea  with 
lowtM  measure  L(A)  « cu(D  o A)  and  upper  measure  0(A)  • (l*S)cu(DnA)  ♦ ycuCD*^  n A)  where 
Vi  la  I.elw'sque  measure.  Provided  D haa  high  |K>sterior  probability  induced  by  u , the 
|H)sterior  range  of  measures  is  then  close  to  the  posterior  measure  for  a uniform  prior. 


of  Maaaures 


Given  a pair  Oj.Oj  aemaureH  on  (H,B).  we  eay  Oj  i »f  ffltA'  f‘’i 

all  A I B , Let  L and  U be  d-finite  neaeurea  on  (H,B)  eatlsfying  I.  I'.  T)iv 

range  of  aeaeuree  K(L,U)  cunslats  of  all  neaaurea  2 auch  that  h ^ 2 ^ U . Kgiiivaloiit  ly , 

if  L and  U have  denaltlea  t and  u with  re8(>ect  to  aome  definite  meaauie  v >>n 
(H,B)  , than  K(L,ll)  conaiata  of  meaaures  with  denaitiea  q with  reai>ect  to  v aatiatying 
t(e)  ^ q(8)  Ivl  . If  2 « R(L,U)  , then  the  odda  ratio  f‘’t  A,H  i B la 

bounded  by  U(A)/l.(B)  whenever  that  bound  ia  well-defined.  The  meaauie  I,  will  (»•  ..riled 
the  lower  aenaure  and  the  aeaaure  U the  upper  aieaaure. 

A real-valued,  B-eieaaurable  function  b on  « ia  called  a t'et , and  bit*!  the  i'a^of  t 
received  if  l*  ix^cura.  A probability  atatewent  ia  defined  aa  the  acceptance  of  ».»»<■  con- 
vex claaa  of  beta  containing  no  atrictly  negative  bet.  For  a meaatire  2 ut*  let 

2(b)  denote  the  integral  of  b with  reaiwtct  to  2 • The  measure  2 > interpreted  aa  a 
probability  atatenent , ia  taken  to  mean  the  acceptance  of  all  In'ts  b for  which  2(U'l'  ' ■*' 
and  2(^*  2.  courae,  2j  “tid  2j  accept  the  same  beta  if  and  only  if,  for  some 

conatant  ,»  ■»  0 , 2j(A)  • for  all  A « Bi  thus  prof'ortional  measures  are  equivalent 

probability  atatementa, 

A bet  b ia  RlL,U)  -nonnsgative  if  2(|l>h  ' " 2(^)  2.  ('  ''Very  2 »»  Kd  .1’) 

The  range  of  meaaurea  R(l.,li)  , interpreted  as  a probability  statement,  ia  taken  to  mean  the 
acceptance  of  all  R(L,1)) -nonnegative  beta.  The  class  of  all  measures  proi^rt  ional  tc>  s.we 
member  of  R(L,U)  is,  thus,  equivalent  to  the  probability  atatianent  K(l.,li)  . For  any  WM 
b , define  b^lO)  - b(t))  if  b(e)  2.  ^ • l’*(t))  - 0 if  bit*)  - 0 , and  define  b‘lt>)  - 
bie)  - b*(t)).  Since  2(W  - 2(b*)  ♦ 2(1**)  ^ l.lh*)  ♦ U(b*)  for  all  2 iu  Rll.,l*)  , we 
see  that  a bet  b ia  R(I,,ll) -nonnegative  if  ami  only  if  V)llb|)  -■  -v  and  l.lb*)  * Ulb  ) 2.  *'• 
A bet  b ia  R(L,U)  -positive  if  l.(b*)  ♦ Ulb  ) ' 0 . 


'Vtal 


1.  Rangcii  o(  Poster loi  Measures 


Bayes  Theorem  stales  that  if  (P  |(?t  H)  is  a family  of  probability  mi'asures  defined 


on  a o-field  F of  subsets  of  a sample  space  X , where  P has  density  f(x|6)  with 


respect  to  a o-finite  measure  v on  (X,F),  and  if  is  a probability  measure  on 


(H,B),  then  the  unique  p>robability  measure  on  (X  » H,  F * B)  having  ('-marginal  measure 


and  regular  conditional  distribution  given  B is  the  proliability  measure 


2 with  density  f(x(t')  with  respect  to  v » . Furthermore,  the  regular  conditional 


distribution  of  Q given  F has  density  f (X  | (') //f  (X 1 0)dQ^  (0)  with  respect  to  . It 


is  straightforward  to  extend  Bayes  Theorem  to  the  class  of  improper  o-finite  priors  Q for 


which  the  induced  measure  Q has  o-finite  X-marginal  measure,  as,  for  example,  in  the  casi 


where  X|^^  ' N(0,1)  and  is  the  uniform  prior.  However,  if  the  X-marginal  of  Q is 


not  o-finite  then  it  is  (Possible  that  viX  i X|  /f  (X  | (')  dtj^  ( (')  • "t  is  positive,  so  that  a 


conditional  pirobabi  1 ity  measure  for  P given  X cannot  be  defined. 


For  example,  if  P (X«l)  - P , P (X«0)  - 1-0,  and  dQ  /do  • 0 (1-0)  , 0 ^ 0 ^ 1, 


then  /f  ( xj  oldf^  (p)  - Jo^  ^(1-0)  ^do  • -»  for  all  X . Thus,  the  posterior  probability 


density  “prescribed"  by  Bayes  Theorem  equals  zero  if  0 •-  0 ' 1 and  is  indeterminate  at 


0 " 0 and  0 • 1.  Ni'verthe  less , the  measure  dp^(p)  0^  ^(1-0)  ^dp  is  a probability 


statement  about  fl  according  to  which,  given  X , all  bets  b{0)  such  that  J b(0)di;)^(0) 


0 are  acceptable. 


To  accommodate  all  o-finite  piriors  we  will  generalize  the  concej't  of  a regular  condi- 


tional {'robability  measure  to  that  of  a regular  conditional  measure  which  will  Ih'  inter- 


p'reted  as  a conditional  prolvability  statement. 


Definition  3.1.  Let  Q be  a measure  on  (s;,S)  and  let  D W'  .i  sub-o-f'eld  of  S . A 


family  (Q  i il)  of  measures  on  (il,S)  is  a regular  conditional  measure  given  D if 
u) 


for  every  S-measurable , Q-integrable  function  b 


1)  0 (b)  is  D-measurable  and  finite  Ifl \ 


ii)  Q (gb)  • g(ui)C  (b)  (tf)  for  every  K'unded  D-measurable  function  g ; 


iil)  Q (b)  - 0 (Cl  imi'lies  (J(b)  - 0 . 


The  existence  of  such  a family  requires  regularity  conditions  similar  to  those 


guaranteeing  the  existence  of  a regular  conditional  prolvibility  measure  (see  Kenyi  (IPIp) 1 . 


fPI 


If  Q{1.)  * I «ind  Q (n)  » 1 (Q)  then  QCqb)  » Q(9Q/  .(b))  for  all  bounded  D-neasurable 

ui  t • ; 


g and  ^-inteqrable  b ; thus  {q  |u)  t fl)  is  a regular  conditional  probability  given  D . 


In  particular,  iQl-unlcjue.  For  unbounded  measures  Q we  prove  the 


fol  lowir.g ; 


Lemma  3.2.  Assume  Q is  o-finite  or  S , and  let  {q  |w  f {q*  |ii>  e fi}  be  regular 


conditional  measures  for  Q given  D S.  Then  there  exists  a Q "O^easurable  function  k 


such  that  k(^u)  0 for  every  w t il  and  Q (b)  ■ k(u))Q*(b)  [Q]  for  every  Q-integrable  b. 


Proof . Q o-f'-iite  on  S is  equivalent  to  the  existence  of  an  S~™easurable , Q-integrable 


function  b such  that  ^ every  u)  f Since  Q ,Q'  are  countably  additive, 


Q (b  ) • 0 and  Q*  (b_)  > 0 for  all  w e . Define  k((j)  * Q (b^)/Q*(b  ).  Let  b 

-j  0 oj  0 ^(1)  0 0 


any  non-negative,  S-measurable,  Q-integrable  function,  and  let  C(a))  ®0  (b)/0  (b  ), 

*0)  0 


C*(w)  » Q*(b)/Q*(b  ).  Define  C'  (u»)  * 0 if  C(u))  > M , C^(w)  * C(w)  if  C(u))  < M. 

w ui  u n M ” 


Then  Q (C  - b)  - C (u)Q  (b  ) - Q (b)  [01  . Letting  M + <»,  we  find  by  the  monotone 
ui  n u M ui  u u) 


convergence  theorem  that  Q (C  b„-b)  =0  [f^l  . Hence,  o(C  b_-b)  = 0 ; similarly, 

u 0 '0  ■* 


QCC'bg-b)  = 0.  Thus,  Q(b|^(C-C'))  = 0 . Let  A = {uIcCu)  > C'(ai)}.  Applying  the  above 


argument  to  the  function  1 b,  and  noting  that  Q (1  b)  = 1 (oilo  (b)  and  O'  (1  b)  = 

A “(,)  A A ID  ID  A 


l,(iD)Q'(b)  since  At  H,  we  find  that  Qtb.l,  (C-C' ) )=  0.  But  b„(C-C')  is  strictly 
A u)  0 A 0 


positive  on  A ; hence,  0(A)  = 0.  Similarly,  Q{id1c(id)  < C'(id))  = 0 , and  so 


C(u'  = C ((d)  (Q)  . We  have  snown,  then,  that  Q (b)  = )c(id)Q' (b)  (Ql  for  any  nonnegative 

U)  U) 


S-measurable  0~integrable  b.  For  arbitrary  S-measurable  Q-integrable  b = b^  + b , the 


desired  equality  holds  since  it  holds  for  each  of  b and  b 


A regular  conditional  measure  {q  |id  e 0},  interpreted  as  a conditional  probability 


statement,  is  taken  to  mean  the  acceptance  of  all  Q-integrable  Isets  b for  which 


Q (b)  0 [Q]  . By  Loimna  3.2,  conditional  probability  statements  are  unique. 


Bayes  theorem  for  unbounded  priors: 


Let  (X,  F)  be  a sample  space,  and  let  {Pg|0  t Q)  be  a family  of  probability 
measures  on  ( X, 0 with  densities  f(x|e)  with  respect  to  a o-finite  measure  v on 


( X,  F)  . Let  Q^  be  a o-finite  prior  measure  on  (f3,B)  . 


Vh«'n  thfio  rkinta  4 UMivivir  IXi^a^viiv  ^ on  (X  * H,  T ' B)  sui'h  t(>at  kvjit-cs  with 

on  B ,tiul  nuoh  that  < **1  i»  a rtKjular  oondttiotval  measure  ot  J vjrven  B , 

V'  t' 

i»  o-tinite  on  F ' B . A legulai  ooiuUtional  measure  of  Q given  F is  ^ 

whrie  0(h>  / (Xit>)dv',(<*>  . 

' H 

l‘i >>ot  ■ let  j,'  have  density  f(x|s)  with  rosj'eot  to  v ' Tonelli's  Theorem  imi'lies 

that  for  every  B t 8.  ClX  » B)  • ! j t (X 1 0) dv (X) dQ  (ti>  » C!„(B)  . Sinoe  U,  i»  o-finite 

kIb  X 0 0 0 

A'n  B , ^ in  v'-tiuite  on  F 8 . 

Viewing  B Asi  4 aul'-x'-lf of  F v B in  the  obvious  way,  we  next  shv'w  that 

> »*'  IS  a tegular  ooiiditional  measure  of  given  B in  the  sense  that  the  family 

.'f  measures  1^.'  |x  t X , 0 < t*t  defined  hy  o (A  ' B)  I'  lA)  I,  lt>)  for  At  F,B  t B 

X • r A » 0 SB 

satisfies  ot'ndltions  i,  li,  iii  of  Oef  init  itvi  J.l.  Let  b be  any  F ' B -measurable , 

o- lilt  et)i  able  tunotuvi.  Then  ^ (b)  • f b(  t , S)  f It  | S)dv(t)  P lb)  is  B-measurable  by 

fubini's  rheoiem.  If  g is  any  K'unded  B-measurable  on  X ' H then,  without  loss  ot 
genetality,  g is  a funotion  only  of  t>  and  so  P (bg)  » / bl  t , t')  g ( 0)  f ( t ' t')  dv  1 1 ) « 

* X 

g(!')p  lb).  Pinally.  if  P (b)  ■ 0 lO)  then  P (b)  - 0 k'„l  and,  bv  Pubini's  Thevnem, 
ii  (I  0 *0 

^•(l.)  . . P j(b)dy'^^(t»  ' O . 

Now,  supiw'se  i,'*  IS  a measure  on  (X  ' H,  F'  B)  which  agrees  with  on  g and 

ft'i  whioh  ll'jjt'  A regular  oonditional  measure  given  B . Then  C'  t'*  o-tinite, 

as  IS  , It  O . F V B and  y'U")  , ij'(i')  are  Ix'th  finite  then  Cl.')  • 0^*’^, “• 

C’ tP^jl  I ,) ) • w'' I'' • Since  C At'^'  C Ale  Ix'th  .'-finite,  it  follows  that  C * C- 

Pinally,  we  stu'w  that  is  a regular  conditional  measuie  of  C given  F , 

in  the  sense  that  the  family  of  measuies  IC^  t X , t>  » defined  by  ^^lA  ' B) 

.^IX)  t tlxjtldCylt)  foi  A t F ,B  t B satisfies  oonditions  i,iii,iii.  Pubini's 
B 

Phf.'tem  implies  that  F-measurable  tor  every  C-t''*egrable  b . And  obviously 

* .llX'C^lb)  toi  any  K'un.led  F-measurable  g.  laistly.  suppose  (F')  “ 0 Icl  . 

let  -X  0 lb'  “ 0 Bv  Pubini's  Theorem,  C"''  “ * ’I  )X)0  Ib'.lilX)  » i'  . 

X A - .A 

Die  me.rsures  w'^  • ^ Are  called  iH->sterior  measures,  given  the  ob.servat  ion  X , 

indui.  ed  by  t)ie  prior  measure  We  interpret  unbounded  measures  to  maXe  prolwbility 
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MMHUiiiMiS 


■tatoMnts  as  follows.  For  the  prior  the  6-sieasurahle  bet  b is  acceptable  when- 

ever b is  Q^-inteqrable  and  QQ<b)  > 0 . Bets  b such  that  b and  -b  are  acceptable 
are  fair  bets.  For  the  conditional  measures  P^,  any  F « B-neasurable  bets  b such  that 
Pg(b)  > 0 {Qpl  are  acceptable.  Any  bet  b is  the  sum  of  the  P^-fair  bet  b(6)-Pgtb) 

and  the  B~SMasurable  bet  P (b) . Bayes  Theorem  states  that  there  exists  a unique  measure 

0 j 

Q on  (XxB,  FxB)  such  that  b is  Q-acceptable  (i.e.  Q(b)  0)  if  and  only  if  b 
is  the  sust  of  a Pg-fair  bet  and  a Qg-acceptablc  bet.  A subset  of  these  Q-acceptable  bets 

I 

consists  of  all  bets  acceptsbls  according  to  the  posterior  measures  Q^,  X t X,  namely, 

all  beta  b such  that  2.  0 iQl • ®y  Lenoa  3.2,  the  set  of  posterior  acceptable 

beta  is  uniquely  determined  by  0 and  {P„l6  e B) . See  also  Freedman  and  Purves  (1969)  . 

0 9 

If  Q.  c R(I.,U>,  then  Cv  ‘ R(L„.U„).  For  if  L(A)  1 Q-(A)  £U(A)  for  all  A c B 
0 XXX  0 

then  it  follows,  since  f(x|e  ) >_  0,  that  i.  A c B.  Thus,  ‘ 

Bayes  Theorem  "works”  for  ranges  of  prior  measures  in  that  a range  of  prior  measures  is 
transformed  given  X into  a range  of  posterior  measures.  Indeed,  dL/dU  •=  dL^/dU^, 
so  that  the  density  dL/dU,  which  indicates  how  far  apart  the  lower  and  upper  measures 
are,  is  unaffected  by  the  observation  X . 

J-i 


f 
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4 . Bounds  on  Integral  Ratios 

For  the  B .ressurablt’ , U-inte.jrablo  b«-ts  b and  c,  with  c K (I, ,1') -j'O; i t i vo , con- 
sider the  ranqe  of  integral  ratios  tf(b)/2<c)  for  Q >,  [<(L,b')  . Of  i-articular  interest 
IS  the  bet  c(fl)  ••  f(X|e)  for  fixed  X , corresponding  to  posterior  expectations. 

Theoren  4.1.  L.t  and  W*  the  infixiuni  and  supremum,  respectively,  of  f(b)/C(c) 

for  Q . R(L,U).  For  i . define  J^(\)  - t’(b-Xc)'  •*  L(b->c)*  and  J,(V1  « 

U(b-Vc)*  ♦ L(b-«c)  . Then  J.(i)  < 0 if  and  only  if  i ' ■ : and  J,(i)  ■ 0 if  and 

1 11 

only  if  i.  > i.  Thus  \ is  the  unique  solution  of  J (i)  « 0 . 

1 1 1 

Proof . Let  c^  - inf{Q(c)|Q  . K(L,U)1,  c^  ■ sup'(Q(c)  < R(L,r)}.  Since  c is  U- 
integrahle  and  R(L ,U) -j osi t i ve , Cj  and  c,  are  finite  and  [ositive.  Furthermore, 
|C(b)/p(c)l  ^U(lb|)/Cj  - ••  for  all  Q t R(L,U),  so  that  1^  and  are  finite. 

Since  J^(i)  • inf {Q(b-lc)  |ij  i R(L,U)),  ^ ^ if  only  if  0 Moreover, 

for  any  t > 0 , i ♦ *'^’"1  — 'l  which  in  turn  imp'lies  \ + ■ 

Thus,  i < ij  if  and  only  if  O'  J^CX),  ^ ^ only  if  O'  J^(X),  and  so 

Xj  is  the  unique  solution  of  J^(\)  • 0 . The  result  for  X^  follows  similarly.  • 

In  particular,  if  U (H)  < .»  then  for  any  A < B,  sup{Q  (A) /Q  (eX)  t R(L,L')  X ' 
U(A)/{U(A)  + LlA*^))  and  inf {Q ( A) /Q (P»)  Iq  « R(L,l')  t - L(A)/(L(A)  + I'Ca'^I).  For  .any 
B^tneasurable  bet  b , we  define  the  lower  and  upper  distribution  functions  of  b by 
Fj(t)  - inf{Q(A^),'C(H)  Ic  , R(L,U)X  and 
F^lt)  « suplQ(A^)/Q(H) IC  < R(L,U)) 

where  A^  = {b(0)  £ t).  If  U(A^)  is  continuous  and  strictly  increasing  in  t , then, 
for  0 < n < la  the  lower  and  upper  a-porcent  points  of  b are  the  unique  solutions  of 
F2(t)  » a and  Fj(t)  * respectively.  In  the  special  case  where  I’  = kL  for  some 

k > I , these  are  simply  the  a/{a-*^k-.tk)  and  ak/(l+v\k-a)  percent  points  of  b with 
respect  to  L . 

Example  4.2.  Let  H « R and  supi'oso  that  L is  Lebesgue  measure  and  V * kL  for  som*’ 

constant  k > I j we  are  supposing,  then,  that  the  prior  measure  of  any  set  does  not 

exceed  k times  the  prior  measure  of  any  set  of  the  same  LelH'sgue  measure.  If 
2 

X % N(P,o  ) given  0 , with  o-  known,  then  the  i>osterior  measure  range  is  R(L,.  ,1’.) 
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where  has  <lensity  • (/Jjiojj)  ^expl-  j(X-0)*/Oq)  with  respect  to  Lebesgue 

measure  and  has  density  k f(x|0). 

The  upper  and  lower  posterior  distribution  functions  of  B are 


F2(t) 


k ♦ ((t-X)/Opl 

1 + (k-l)*((t-X)/Opl 


and 


^[(t-Xl/Op) 

' k - (k-U'HU-Xl/o^l  ' 


t c R 


where  ♦ is  the  standard  normal  cdf.  For  0 < a < 1 , the  upper  and  lower  posterior 
n-percent  points  of  0 are,  respectively,  the  ok/d+ak-a)  and  a/(a+k-ak)  percent 
points  of  N (X,o^  ) . 

The  posterior  moan  Q (Of (x 1 9) ) /Q (f (X 1 0) ) , g t R(L,U) , has  minimum  value  satisfying 
(0-X)  + Ljj(O-X)*  « 0 , and  maximum  value  satisfying  Ujj(O-l)*  + li^(B-X)  » 0 . It  is 

oauily  seen  that  this  range  of  posterior  moans  is  IX-OpY(k),  X+o^Y(k)I  where  y(k) 
satisfies 

kY  “ (k-l)(^(Y)  + y*(y)) 

and  are  the  standard  normal  density  and  cdf.  Table  1 displays  values  of  y()()  fof 

1 ^ k ^ 10.  It  is  soon  that  a substantial  amount  of  variation  in  the  prior  has  only  a 
minor  effect  on  the  posterior  mean  of  O,  es  compared  to  the  variability  of  the  estimate 
X duo  to  the  data. 


»v-»r 


I 


5.  Bounds  on  Variances 


for  a B-raoasurable  bet  b on  H , we  will  characterize  the  range  of  the  variance 
of  b , v^(b)  Q(|b|‘)/0(H)  - jg(b)/C(B)|^  , for  Q t R(L,U)  when  U(|b|^)  < “>  and 

U(H)  V We  note  first  that  without  loss  of  generality  we  may  assume  (H,  B)  • (R^,B^), 
where  B^  is  the  Borel  o-field  on  R^,  and  b(0)  - 0.  For,  let  B(b)  denote  the  sub- 
o-field  of  B generated  by  {b  ^(A)|a  t B^)(  and  let  R^^CL.U)  be  the  family  of  measures 
Q on  (H,  B{b) ) satisfying  L(B)  2(B)  ^U(B)  for  all  B < B(b)  . Clearly,  R(L,U)  f 
R^(I.,U).  Now,  the  mapping  Q * Q* , where  Q*(A)  « 2(b  ^ (A) ) for  A f B^,  defines  a one- 
to-one  correspondence  between  R(L*,U*)  and  Rj^(L,U)  with  respect  to  which  is 

invariant.  I'urtliermore , if  2 i Rj^(L,U)  then  there  exists  some  B(b) -measurable  func- 
tion a such  that  0 < a(0)  < 1 lUj  and  2fB)  - L(ul  ) + U((l-a)l  ) for  every  B < B(b) . 

— — B B 

Pefining  2* * U((l-a)l^)  for  C t B,  we  see  that  2'  ' R(L,U)  and 

V^, (b)  • V^(h)  . Hence,  the  range  of  V^(b) , 2 ' R(L,U)  equals  the  range  of 

/|t-a  |^d2*  (t)/  /d2*(t),  2*  r R(L*,U*)  where  a » /t  d2*(t)/  /d2*(t).  Tliroughout  this 

section,  then,  we  will  assume  without  loss  of  generality  that  (W,  B)  « (R'^,Bp)  and 
b(!))  - t'. 

2 

The  following  notation  will  prove  useful.  For  -<»  < a < “>,  define  o^Ca)  - 
inf  (2(  I 0-a  I I2  ' Rd.,!!)  ) and  o^Ca)  « sup{2(  | 0-a  | ^) /2(d)  Iq  < R(L,U)).  And  for 

o ' 0 let  J^(a,o)  ” U((|0-a|^  - 0^)  ) + L ( ( | 0-a  | ^-o^)  ^)  and  « 1,  ( ( | 0-a  | ^-o^)  ) + 

Li((|t>-a|  -o")  ).  By  Theorem  4.1,  o^(a)  is  the  unique  nonnegative  solution  of  Jj^(a,o)  ■ 0. 

Next,  for  0 ' X < 1 define  2^  ' R(b,U)  by 


XL(A)  + (1-X)U(A)  if 


XU(A)  + (1-X)L(A)  if 


A c { I 0-a I < Oj (a) ) 
A c ( I fl-a  I ' Oj  (a)  ) 
A • (a-Oj^  (a)  1 
A ■ {a+Oj (a) ) . 


2 

Dt'fino  ^ similarly,  with  the  roles  of  L and  U reversed  and  with  (a)  replaced 
by  Note  that 

"i‘“’  * «X,a‘l'’‘“l^'''®X,a“^’ 

for  I « 1,2  and  for  all  0 ^ 1 • Furthermore,  if  a satisfies  2* 

for  some  0 \ ^ 1 then  oJ(a)  is  the  variance  of  O with  respect  to  oj  ^ • 


Th«or— I 5.1.  L*t  Aj  - 1*|qJ  ,^^***'  “ 1 ' i ' ' *'>'1  a*^'*’’*  * '' 

for  aom*  0 ^ \ ^ 1).  Then  A^  end  A^  are  m>nfiiii|<ty  ami 

i)  inf{v^(0)|o  . R(L,0)l  - lnrUij(4)|a  . Aj  t 

H)  BuplVg(0)  Itf  . R<L,li)  ) - lnf{iij(a)|a  « A^  ) . 

R«»afK.  In  general,  A^  anJ  may  contain  more  than  one  vaUie.  However,  Ui)  imj'lics 

2 

that  Oj(a)  I*  constant  on  A^. 
proof  of  Theorem  5.1. 

It  la  readily  aeen  that  and  are  continuous  and  that  11m  o^la)  - *1  thus 

a 

lnf(Oj(a)  I -*•  < a < «*)  and  Inflo^la)  1 -<«  < a < are.  In  fact,  attained.  We  now  show 
that  a minimises  o^la)  only  If  4 < A^ , from  which  It  follows  that  and  A,  are 

nonempty. 

Consider,  first,  u^.  If  a minimises  then  J^la  1 «,o^(a)»  2.  1' 

^ ' 0.  Let 

Gj(a,o)  - / {(>-a)dL(0)  + / (t'-aldlMf)  . 

I C-a I <0  1 0-a I 'o 

It  Is  straightforward  to  show  that  for  all  — • < a v .»  and  0 v ^ o , 

Jj(a+{,o)  “ Jjla.o)  - * olLlatol  - V'la-oM  > chilli 

and 


“ Jjla,^)  t 2iMG^(a,o)  + o|U(a+o)  ■ L(a-o)1  t o^(l)l 

where  0 ^ 4 0 . Since  J2(a,0j(a))  « 0 we  see  that  a minimises  o,(al 

only  if 


i)j(a)  lL(a-iij(a))  -U(at02(a))l  <.  G2(a,o_j(a) ) ^ o,  (a)  ll' (a-o^  (a) ) -L(a4o„(a))l 


•A 

or. equivalently , only  If  there  exists  some  0 v \ v 1 such  that  o"  (0-a)  - 0 

- - ''\,a 

only  if  a , A^) . Thus.  A^  ^ and  inf(0j(a)  | ^ a v .»)  - InfiCj(a)  |a  , 

Next,  consider  0j(a)i  define 

G^la.vil  - / (0-a)dV)(0)  t / (O-a)dL(O)  . 

|i>-a|»n  1 0-a  I 'o 

An  analysis  similar  to  that  for  Oj(a)  demonstrates  tliat  a minimises  Oj  (a) 


(i  .e. 


A?'- 


on 1 y if 


Oj  (a)  lit(a-.i|(al ) 


L(a40j(a))l  ^Gj(a,Oj(a))  ^ Oj  (a)  |l.(a-Oj  (a) ) - lMa4c^(a))l. 


I 

! 


f 


since  L ' 1)  , tins  is  cqvii valent  to  (0-a)  » 0 foi  alt  O ■ V • 1.  TIuib,  A < ; j 

aiut  InflOj(a)  1 • a ' *’)  ■ lnf(o^(a)|a  < A^). 

Now, 

inf  V^(0)  - inf  inf  C*  I •’-»  I ' 

ij.  Kd.plO  gtK(t.,Ut  -«.  < a < ■» 

2 2 2 
inf  inf  t!(|<’-a|  )/0(M)  - Inf  c^ta)  - inf  o^(at 

-.V  . a QiK(l.,tl)  a < ^ a. 

witich  jiioveK  (i).  Aiui 

nni'  V ^(0)  • sup  inf  ij(  1 1'-a  j “') /CitM)  ^ 

Vi.K<l.,tl)  • a < •” 

inf  sup  C( 1 0-a I /y (M)  « 

^ A ' 

inf  ■ i»*f  ‘\(a)  2. 

-A  s,  rt»  ^*^2  * 

where*  the  last  iniHiuality  follows  fixim  tiu*  fact  that  a * implies  o,^(a)  * 2 

,a 

for  s^t«e  0 V < I I thus  statement  (ii)  is  proved,  • 

F.xample  S.2.  Consider  the  normal  location  problem  of  Fxample  4.2,  and  let 
denote  t)je  minimum  and  maximum  I'oaterioi  variance  of  0 as  the  pr  iiu  lafuies  over  R(L,iO. 
Applyinq  Theorem  !i,l  to  noting  that  • (X)  in  tins  case,  we  f intt 

that  amt  aio,  respect  ivoly , the  unique  solutions  of  -Vt  ) ♦ 

|0-x|^-V)  - 0 amt  1.^(((0-X(^-V)"l  ♦ ( < | t'-X  T'-V)  ‘ ) - 0 . I'rfininq  iKA.c)  - 

2 12  2 
Ait(A)  ♦ (A  -l)14(A)-cl,  It  is  readily  seen  that  unique 

> 2 

solution  of  H(A,c,)  - 0 with  c,  - (K-2) (2K-2>  . Amt  v;;  - A,.'*  whole  A,  is  the 

I I .X  a (>  » 

unique  soltitlon  of  iKAtC^l  • <>  with  c^  * (2k-l)  (2K-21  . Table  2 gives  valui's  of 
and  A^  for  I ^ ^ W*'  ***'*'»  f*-'*  example,  that  if  the  pt  ioi  v.iries  .iWsit  the  \inifoim 

prior  by  up  to  a factor  of  twi',  the  postei  ioi  standard  deviation  is  afte«.'te<l  by  no  more 
than  17%  of  the  standard  error  I'f  the  data. 


Table  2 


k 

"2 

k 

^1 

^2 

1 

1 

1 

4 

.697 

1.360 

1.25 

.947 

1.055 

5 

.654 

1.421 

1.50 

.904 

1.100 

6 

.621 

1.472 

1.75 

.870 

1.140 

7 

.574 

1.515 

2 

.840 

1.174 

8 

.592 

1.552 

2.5 

.79,: 

1.233 

9 

.552 

1.585 

3 

.754 

1.282 

10 

.535 

1.615 

1 

Example  5.3.  The  mixture  parameter  \ of  Theorem  5.1  is,  of  course,  relevant  only  if 

2 2 

U IS  not  continuous.  In  the  discrete  case,  the  functions  and  are  easily 

minimized  since  they  are  piecewise  quadratic.  For  example,  if  6 = ^®l'®2^  with 

®1  ®2'  denote  - LO^),  « U(e^),  i » 1,2,  then  = 

(|e^-a|^L^  + |02-a|^U2)/(L^+U2)  if  a < (6^+02)/2,  and  (a)  = ( 1 0j^-a  + 1 02-a  l^^)/ 

(Uj^+Lj)  if  a ^ (0^+02)/2.  If  and  ^ , we  find  mino^Ca)  » (02-0^)V4, 

attained  at  a « (9j^+02)/2.  These  are  the  variance  and  mean  of  the  uniform  measure 
2 

Q,  _ £ R(L,U),  where  a » <0,  + 0-)/2  and  1 » (U,-L,  )/(0,+0,-L,-L.)  . 


i 

I 


i 
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6.  As'/mptotic  Behavior  of  Ranges  of  Posterior  Expectations. 

Let  the  observation  X.  have  sample  space  (X.,F.)  i = 1,2,...,  and  define  X = ff  X., 

1 11  OOj^l 

F = n F . Suppose  tP  1 6 e B}  is  a family  of  probability  distribution  on  (X  ,F  ) such 

^ i 0 Co  00 

that  is  B-measurable  for  all  A e F^.  Let  Q be  any  measure  on  (0,B)  and  let 

Y . . . be  any  sequence  of  random  variables  on  (X^  x Q,F^  x B) . The  notation  Y = 0 [Q] 

will  mean  that,  except  for  some  set  of  0-values  of  Q-measure  zero,  P„{X  e X |Y(X,e)  = 0}  = 1. 

Similarly,  the  notation  ^ IQJ  will  mean  that,  except  for  some  set  of  e-values  of  Q- 

measure  zero,  X^(X,e)  converges  to  y(X,0)  with  -probability  one. 

Assume  further  that,  for  all  0,  the  (X  ,...,X) -marginal  distribution  of  p has 

i.  N 6 

density  f(X  ,...,X  |0)  with  respect  to  some  o-finite  measure  u on  {X,x  . . . x X.  , F x 
IN  N 1 N 1 

...  X F ).  For  a B~measurable  bet  b and  a measure  Q on  (0,B) , we  will  denote  Q (b)  = 

N 

/ b(e)f  (X  , . . . ,X  |e)dQ(0)  ; and  for  A e B,  define  Q„(A)  = Q„(l  ). 

If  Q is  a probability  measure  and  Q(|b|)  < “,  the  Martingale  Convergence  Theorem 

(see,  for  example,  Doob  (1949))  implies  that  Q..(b)/Q„(l)  -*■  b(0)  [QJ  for  any  F -measurable 

N N 00 

bet  b . In  particular  lira  UnT  Q.,  ( |b |l  i.  , „) /Q„ (1)  =0  [Q]  ; and  Q„(A)/Q„(1)  -xl,(0)  [Ql 

N |b|>M  N N N A 

if  F^-measurable . We  now  show  that  these  conditions  are  essentially  sufficient 

to  extend  the  martingale  result  to  o-finite  measures  Q . 

W 

Lemma  6.1.  Assume  Q is  a o-finite  measure  on  (6,B) : let  0 = U A.  with  A.  e 8 dis- 

1 ^ ^ 

joint  and  0 < Q(A^)  < ».  Suppose 

i)  b(9)  is  F -measurable; 

OO 

ii)  tv.,I  for  sufficiently  large  N ; 

N N 

iii)  Q„(A.)/0„(1)  H.  1,  (0)  [Q]  for  i = l,2,...  ; 

N 1 'N  A . 

1 

iv)  lim  Urn  = 0 (Q)  . 

M-x»  N ' ' 

Then  Q„(b)/Q„{l)  .x  b{0)  [Ql  . 

N N 

Proof ■ Note,  first,  that  if  A e B,  0 < Q(A)<  <»,  and  Q([bl^[)<  <»  then,  by  the  Martingale 
Convergence  Theorem  applied  to  the  prolaability  measure  ; Q(A  n D)/Q(A)  for  D e B, 

it  follows  that  Qj^(bl^)/Qjj(A)  converges  to  b(0)  with  Pg-probability  one  for  all 
f ■ A c A where  Q(A  - A ) = 0 . 


5- 


Now,  suppose  |b(9) 1 < M for  all  6 . Then  2(|bl  |)<  * for  every  i . For  any 

fixed  e t A such  that  and  "*  1 with  Pg-proba- 

bllity  one,  it  follows  that 

1M  |l  - I " ° 

Ai 

and  so  also  that  C„(b)/Q  (1)  ■»  b(0)  with  P -probability  one.  By  (iii)  , then,  we  obtain 
N N V/ 

o^(b)/Cjj(i)  - bO)  re)  . 

For  unbounded  b , define  b (9)  = b(9)  if  |b(9) | < M and  b (9)  = 0 otherwise. 

M " M 

Then  PQ(Q„(b  )/Q  (1)  -►  b„(9)  for  all  M = 1,2,...  ) = 1 [Q]  . Fix  9 ; then  for  all 
p N N N n 

M > |b(9)  I , 

lc„(b)/c^{i)  - b(e)|  i l2^V/eN‘^’  - ^ eN^I‘’l"|b|>M>/2N<i>  • 

Thus,  (iv)  implies  that  Q„(b)/Q  (1)  ■*  b(9)  (Q1  . ■ 

Remark.  Clearly,  assumption  (i)  may  be  replaced  by  the  requirement  that  b(9)  be 
equivalent  to  some  F_-measurable  function  h(J^)  in  the  sense  that  Pg(h()^)  = b(9))  =1  [Q] 

If  b(9)  is  estimable  in  that  t (X,  -►  b(9)  to)  for  some  sequence  of  estimators 

t^  , then  b(9)  is  equivalent  to  the  F^-measurable  function  lim  t (X. , . . . ,X  ) . 

If  X^,X2,.>.  are  independent  and  identically  distributed  given  9 , with  sample 
space  (X,F)  where  (X,F)  and  (6,B)  are  isomorphic  to  Borel  subsets  of  complete  sepa- 
rable metric  spaces,  and  if  9 ft  9,  implies  P ^ » then  Doob  (1949)  showed  that 

12  ®1  ®2 

there  exists  some  F^-measurable  function  h on  X^  such  that  Pg(h(JC)  = 9)  = 1 for 
every  9 £ 6.  Hence,  any  B-measurable  bet  b(9)  is,  in  this  case,  F^-roeasurable . 

We  now  prove  that  upper  and  lower  posterior  expectations  determined  by  the  range 
R(L,i;)  of  prior  measures  are  strongly  consistent  estimators: 

Theorem  6.2.  Let  L and  U be  mutually  absolutely  continuous  lower  and  upper  measures 
on  (B,B)  . Suppose  the  density  t(9)  of  L with  respect  to  U is  F^-measurable . If 
the  measure  U and  the  bet  b(9)  satisfy  the  assumptions  of  Lemma  6.1,  then 


sup  |2„(b)/!3  (1)  - b(9)  I ■*•0  [0]. 

Q£R{L,U) 

Proof.  Let  A be  the  set  of  9 £ 0 for  which  £(9)  > 0 and  for  which,  with  P.- 
'■  “ y 

probability  one,  U„{!,(b-X)*  + (b-X)‘)/U„(l)  -►  £(6)  (b(9) -X)"^  + (b(9)-X)'  and 
N N 

0„((b-X)^  + £(b-X)  )/0„(l)  -►  (b(9)-X)*  + £(9){b(9)-X)  for  all  rational  X . By  Lemma 
N N 
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6.1,  U(A  ) • 0.  Fix  t)  . A ami  suj'i'osf  .i  ^ b(l*)  < .1^,  with  i an.l  1.  lational. 

* *>  la? 

Then  (b(e)  - a,)*  ♦ t (P)  (b(0) -u,) ' - 0 . Thus,  with  I’  -lu  olsibi  1 1 1 y one,  t'  ((b-i  . 

J 2 P ‘ N 2 

J(b-u  ) ) < 0 ovt>ntu.ally  wliich,  by  Theonsn  4.1,  tmi'lies  supi^i  (b)/\J  (l)lt'  • P(L,U))  ‘ 1 
* N N 2 

ovontually.  Similarly,  inf  (b) ( 1)  |q  < R(L,U)  I ' .i^  eventually  with  I'^j-yrobabi  1 1 ty 
one.  Since  anil  are  arbitrary,  the  theorem  is  proved.  • 

Convenient  approximations  ti  the  lower  and  upp'er  posterior  expectations  of  b(P)  are 
available  when  b(P)  is  as>'mptot  iral  1 y normal  in  the  following  .sense: 

Pefinition  6.1.  Let  S be  the  set  of  functions  q:R^  » that  are  bounded  and  con- 
tinuous almo.st  everywhere  with  respect  to  Lebesgue  measure;  and  let  be  the  standard 

normal  density.  The  bet  b(P)  is  as^mptot  ically  norm,al  under  U if  for  all  g < S , 

0„(g((b-b„)Ai  ))AI  (1)  * rq(t)f(t)dt  nn  , 

where  1;^  - ( b)  ( D and  0^  - *'^  *^*' A'j^  ( I ' -b‘ • 

Recall  frem  Kxample  4.2  that  for  k ^ 1 , the  constant  v(k)  is  the  uni^iue  solution 
of  /'’(k(t-i)*  ♦ (t-i)’)4(t)dt  - 0 . 

Theorem  to, 4.  Assume  that  the  conditions  of  Theorem  h.2  hold  ami  that  is  asy-mj'- 


totically  normal  under  U , with  mean  h and  variance  e"’ 

N N 


Then 


and 


inf  g (b)/o  (1)  - (b  - i'  i(k  ))1  • 0 [l-l  . 

CJ,  K(L,II)  " " N N H 


rroo£.  We  will  prove  the  desired  result  for  the  m.rximum  posterioi  expect.jtion  of  b ; 

that  for  the  minimum  posterior  expectation  is  similar. 

For  real  \ , define  Z„{\)  - (b( P) -b„) /i<  - \.  Then  I’.  I’  (D  - 1 * \'  foi 

N N N N N N 

all  N . Frii*  the  asymptotic  normality  of  b(P)  under  P , we  find 

lim  lim  iU\^  - t'  (zf,(\)l|,  „'A',(l))  - lim  lUl'  - [ (t-\r|(tKU)  - 0 U'l  . 

M-  N-  ^ MKv  tt-\|.M 
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] 


Honor , 


lim  - /(t-\)%(t)dt|  V Urn  lin.  U„  ( |Zf,  < ')  1 1 , ,,>1  * 

N M*«  N 


♦ lim  I / (t-V)*t(t)dt  - /(t-\)**(t)dt  I - 0 lUl  . 

M 1 1 - \ |_^M 

Similarly,  < '> ' ( 1)  • /(t-\)*^(t)dt  (Ul  . Let  ‘ 

0 ^ iltt)  ^ 1 |l'J  and  li(t')  is  F^-nieasurable,  Lemma  6.1  implies  that  * HP)  lU)  . 

Thus,  for  every  real  \ we  have 

l'^(2*H)  ♦ “ /(t-i)*.Ht)dt  + e(0)/(t-\)'4.(t)dt  lUJ. 

furthermore,  by  the  Cauchy-Sohwartz  inequality. 


U^(l) 


'’n'IS'*'  ’ 2 2 

— vrr~  ‘ uTi)-'  ■ - ‘'n'  ‘ 

N N 


2 2 

since,  by  Lemma  6.1,  ‘ **®”'^®*  For  every  real  \ , 

i'jj(z*(\)  ♦ «z*(\))A'^(i)  * /(t-\)**(t)dt  ♦ c(0)/(t-i)'*{t)dt  nn . 

Now,  let  A denote  the  set  of  0 t H for  which  HP)  '0  and  for  which,  with  P^- 
probability  one,  * tZ^  ( X) ) AJj^  (1)  converqes  to  J(t-X)*<.(t)dt  + HP)/(t-X)  ^ItXdt 

c 

for  all  rational  X.  Then  U(A  ) « 0.  Fix  P t A,  and  suppose  aj  < y(1/<(P))  < u,  with 

and  rational.  Then  J(t-a2)*')'(t)dt  + H'i^)  j ♦(t)dt  < 0 . Hence,  with  P^- 

probability  one,  lt.,tZ*(a,)  ♦ tZ  (a-))  < 0 eventually,  which,  by  Theorem  4.1,  implies 
N N 2 N 2 

that  sup(tf^(  (b-b^)/Ojj)/0j^(l)  |q  e R(L,U)  ) v eventually.  Similarly, 
sup(0^((b-bj^)/o^)/Cjj(l)  Iq  . R(L,ll))  ' aj 

eventually  with  P -probability  one.  Since  a, ,a_  are  arbitrary,  we  have  shown  that 

p 12 

.''lsup{0  (b)/Q„(l)  lo  , R(L,l')>-b„)  ► y(1/«(P))  (H)  . 

N N N N 

Furthermore,  * 1/«(P)  lU)  and  >(•)  is  continuousi  thus,  * y(1/*<<'^)  li'l  • 

and  the  theorem  is  proved.  • 

Theorem  6.4  permits  close  approximations  of  ranqes  of  posterior  expectations  of 
arbitrary  bets.  When  P is  the  true  j'arameter  value,  the  upper  and  lower  posterior 


! 

i 


c 
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1 


; 


of  b ar«  t o^>(l/f(0))  ♦ o(o^)  . Thus,  if  the  prior  Jensity  with 

1 


rospeot  to  U is  uncertain  up  to  a factor  of,  say,  2 in  the  sense  that  5(0)  >^  — lU)  , 
then  the  range  of  posterior  expectations  of  b is  b^j  t .27b  ^ 

satisfying  the  weak  conditions  of  the  theoreia. 


1 i 
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X into  a similar  range  R(L^,U^)  of  posterior  measures.  Upper  and  lower  expec- 
tations and  variances  induced  by  such  ranges  of  measures  are  obtained.  Under  weak 
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Abstract  (continued) 


regularity  conditions,  these  upper  and  lower  jHJsterior  expectations  are 
strongly  consistent  estimators.  The  range  of  I'osterior  expectations  of 
an  arbitrary  function  b on  the  parameter  space  is  asymptotically 

2 

^ ♦ f'lo.)  where  b and  o are  the  posterior  mean  and  variance 

N ' N N ” 


N 


i 


of  b induced  by  the  upper  prior  measure  U , and  where  a is  a constant 
ref lectinq  the  uncertainty  about  the  prior  in  terms  of  the  derivative  of  L 


